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Abstract 

We apply the discrete S 3 flavor symmetry to both lepton and quark sectors 
of the standard model extended by introducing one Higgs triplet and realizing the 
type-II seesaw mechanism for finite neutrino masses. The resultant mass matrices of 
charged leptons {M L ), neutrinos (M^), up-type quarks (M u ) and down-type quarks 
(M d ) have a universal form consisting of two terms: one is proportional to the 
identity matrix / and the other is proportional to the democracy matrix D. We 
argue that the textures of M n and M d are dominated by the D term, while 
that of M v is dominated by the / term. This hypothesis implies a near mass 
degeneracy of three neutrinos and can naturally explain why the mass matrices of 
charged fermions are strongly hierarchical, why the quark mixing matrix is close to 
i" and why the lepton mixing matrix contains two large angles. We discuss a rather 
simple perturbation ansatz to break the <S 3 symmetry and obtain more realistic mass 
spectra of leptons and quarks as well as their flavor mixing patterns. We stress that 
the / term, which used to be ignored from M z , M u and M d , is actually important 
because it can significantly modify the smallest lepton flavor mixing angle # 13 or 
three quark flavor mixing angles. 
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Flavor (or family) symmetries belong to one of a few promising approaches 
toward deeper understanding of the observed mass spectra and flavor mixing patterns of 
leptons and quarks [U El E]- Among a number of interesting discrete flavor symmetries 
discussed in the literature [I], the S 3 symmetry should be the simplest one and has been 
used to interpret the mass hierarchies of charged fermions [5] and predict the well-known 
"democratic" [6J and "tri-bimaximal" |7] neutrino mixing scenarios. A particular merit 
of the S 3 flavor symmetry is that it requires the mass matrices of three charged leptons 
(MJ, three neutrinos (M^), three up-type quarks (M u ) and three down-type quarks (M d ) 
to have a universal form M x = £ X I + ( X D (for x — u, d), where 



D 



stand respectively for the identity and democracy matrices. Hence one may explore the 
flavor structures of leptons and quarks, both similarities and differences of their mass 
spectra and flavor mixing patterns, in a more or less parallel way. 

The above point can be made clear if we extend the standard electroweak model by 
introducing one Higgs triplet and realizing the type-II seesaw mechanism [8] to generate 
finite neutrino masses. In this case the gauge-invariant Lagrangian relevant to quark and 
lepton masses reads 

-Ahl = Q^Y u HU R + Q^Y d HD R + 7[Y l HE R +^Y A Ata 2 £ c L 

-\ A M A H T ia 2 AH + h.c. , (2) 

where Q L and £ L are the left-handed doublets of quarks and leptons, U R , D R , E R are 
the right-handed singlets of up-type quarks, down-type quarks and charged leptons, H 
and A stand respectively for the Higgs doublet and triplet. The last term of £q +l i s 
lepton- number- violating, and thus its dimensionless coefficient A A is naturally small [9]. 
Once the neutral components of H and A acquire their vacuum expectation values, the 
SU(2) L x U(1) Y gauge symmetry is spontaneously broken such that all of the quarks and 
leptons become massive: 

- £ mass = KMJJ R + T\M d D R + ElM^ + \viM v vl + h.c. , (3) 

where the charged-fermion mass matrices are given by M x = Y X (H) (for x = u, d, /) 
with (H) m 174 GeV, and the Majorana neutrino mass matrix is given by M v = Y A (A) 
with (A) = 2\ A (H) 2 /M A . The mass scale of the Higgs triplet M A is expected to be 
much higher than the electroweak scale characterized by (if), so the tiny mass scale of 
M u is apparently attributed to the smallness of A A and the largeness of M A . Current 
experimental data on the electroweak p parameter require (A) < 2 GeV [5]. Now we 
apply the non-Abelian discrete symmetry S 3 , a permutation group of three objects, to 
the lepton and quark sectors. It contains six elements, 
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which fall into three conjugacy classes. Allowing the lepton and quark fields to transform 
as Q L -> S^ jk ^Q L , £ L ->■ S^ ijk H L , U R -> S^U^ L> R -> S^D R and £ R -> S^E R , one 
may easily find that the gauge interactions (or kinetic terms) of leptons and quarks are 
invariant. The Yukawa interactions of leptons and quarks in Eq. (2) are also invariant 
under the same transformations if the following commutation conditions are satisfied: 



V Qfe^)! — \v Cfc'fc)! — \v o{ijk)~\ _ [y q(ijk) 
I u , O — Jj ,>J — 1 1 , O — lAi° 







M x , S® k > 



(5) 



0. 



The mass matrices M x (for x = u,d,l,v) must equivalently satisfy 
implying that they can only take a universal form M x = £ X I + ( X D in the S 3 symmetry 
limit with I = and D = + + = + + 

Because an orthogonal matrix with two large rotation angles is needed to diagonalize the 
democracy matrix D, such as 
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(6) 



it is potentially possible to explain the large solar and atmospheric neutrino mixing angles. 
One can see that Vq corresponds to the democratic mixing pattern [6] while U is just the 
tri-bimaximal mixing pattern [7]. Since H 3 contains a non- vanishing (dominant) matrix 
element in the (3,3) position, it is consistent with the observed mass hierarchies of charged 
fermions (i.e., m t 3> m c 3> m u , m b 3> m s ^> m d and m T ^> ^> m e ) in the symmetry 
limit. This observation means that £ x <C ( x (for x — u, d, Z) is likely to hold for charged 
fermions, while ^> is more reasonable to generate two large lepton flavor mixing 
angles together with a nearly degenerate neutrino mass spectrum [51 [HI [321 EE2J EH]- Of 
course, proper perturbations to the lepton or quark mass matrices are necessary [21 EES] 
in order to stabilize the dominant term of the quark or lepton flavor mixing matrix and 
produce appreciable CP violation in the lepton or quark sector. 

In this letter we stress that the I term of M x , which used to be ignored for charged 
fermions (i.e., ^ = £ u = £ d = was often assumed or dictated by the S 3L x S 3R symmetry), 
is actually important. On the one hand, this term is present in the S 3 symmetry limit and 
thus has no good reason to be switched off. On the other hand, small £ 2 can significantly 
modify the smallest lepton flavor mixing angle 8 l3 , while small £ u and £ d can remarkably 
modify three quark flavor mixing angles. We illustrate our points by discussing a rather 
simple perturbation ansatz to explicitly break the S 3 symmetry and obtain more realistic 
mass spectra of leptons and quarks as well as their flavor mixing patterns. 
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Let us first consider the lepton sector. Based on the S 3 symmetry discussed 



above, the mass matrices of charged leptons and neutrinos can be written as 
M) - I 1 I ! + r, i I I + AM l , 
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where c x > 0, r x is real and \r x \ <C 1 holds (for x = I and z/), and the explicit symmetry- 
breaking terms AM l and AM V are assumed to take the diagonal forms [6j [13] 



AM, 



/ -iS t 
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AM U = c u 
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with < 5 X <C e x <C 1 (for x = / and v). To diagonalize M z , one may transform it into 
the following hierarchical texture: 



M[ ee V T M t V 



9V3 



( 3\/3r l — i35 l 

-i3«J, >/3(3r, + 2e 1; 



-V6£ Z >/3(9 + 3r, + e, 



(9) 



where V has been given in Eq. (6). In the assumption of \r { \ <C e t , we can diagonalize 
M{ and obtain the masses of three charged leptons to a good degree of accuracy: 



1 9 3 



m M w c, 



9 3 



6e, 3 



(10) 



Defining m = c^/3, we have |m | < m . Then e ; and 5; are given by 

2*i 



9 m M - m 

2m T -m ' v/3 



5, 



m„ — m, 
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m, 



(11) 



As a consequence of Eq. (10), the constraint m < m e should be satisfied for m > 0. 
The unitary matrix used to diagonalize M l (i.e., V^M^* = Diag{m e , m , m T }) is found 
to deviate from V at the level of 0{e{) and 0{5j): 



\/6 



m„ — \m r 



/ 1 V3 . 

/- 1 1 m i, 

-V3 + 



1 



\-2 °, 



2 a/3 "V - m 



/0 a/2 -1 
y/2 -1 

\0 v/2 2 



• (12) 



On the other hand, the unitary matrix used to diagonalize the Majorana neutrino mass 
matrix M v (i.e., VjM u V* = Diag{m 1; m 2 , m 3 }) is approximately given by [13] 



1 1 



e v c e 
~ £ u s e 



£ v s e 
£ u c e 



r„ 



(13) 
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where c g = cos# and s g = sin^ with tan 29 = r u /5 u . Three neutrino mass eigenvalues are 

« c„ (1 + r„ + e„) , 



m 2 « 1 + + x/ rl + 5 



m x « c„[l + r v -Jrl + 8* . (14) 



Therefore, Am^ ~ 4c 2 yr^ + <^ and Am§ 2 « 2c 2 £j„ from which r^/e,, « c s e Am^/ Am| 2 

can be obtained. The 3x3 lepton flavor mixing matrix is defined as V MNS = Vi V u 
A straightforward calculation leads us to 

-v 7 ^ (c e - s 6 

^MNS ~ ~Tb I (?0 — ( c 6» + s e) 

V2 (c e + Sg) 

V3(c e + Sg) 





(Cg - Sg) 

- (c fl - s e ) 



2(c -s e ) 2(Cg + Sg) 1 \ . (15) 

\~V2(Cg- Sg) ~V2(Cg + S 6 

Comparing this result with the standard parametrization of V um advocated in Ref. [5] 
(see also Ref. p2j), we immediately arrive at three flavor mixing angles 
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(16) 



together with the Dirac CP- violating phase 5 ~ 7r/2. Two Majorana CP- violating phases 
are trivial in this scenario, and thus the effective mass of the neutrinoless double-beta 
decay is simply given by (m) ee ~ c v . Different from Ref. [13], here both 9 13 and 6*23 get 
modified because of the non- vanishing m = c z r z /3 which signifies an important contribu- 
tion from the / term in the S 3 symmetry limit. Some discussions are in order. 

• A global analysis of current neutrino oscillation data yields 9 12 ~ 34.5° [18] . implying 
9 m 10.5° or equivalently r v /5 u ~ 0.38. We see that the size of 9 is smaller than 
the Cabibbo angle of quark flavor mixing (i.e., 9 C w 13° [5J), so the so-called quark- 
lepton complementarity relation 9 12 + 9 C w it/ 4 becomes less favored than before. 
In addition, we obtain r u /e u « 5.7 x 10 -3 from r^/e:^ CgSgAm^i/ Am 32 with the 
typical inputs Am| « 7.6 x 10^ 5 eV 2 and Am| 2 « 2.4 x 10" 3 eV 2 [TBI - 
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If |m | is significantly larger than m e , the smallest neutrino mixing angle 9 13 will be 
increased. In this case, the magnitude of 9 13 is sensitive to that of m , and thus 
the latter can get constrained from the present experimental data. With the help 
of Eq. (16), we obtain 



2m 



m n 



for m < and 



+ 3m, , sin' 
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13 



2-3 sin 2 9 



13 



m, 
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H — m„ sin 2 9 



18 



(17) 



ol 



> m e . Given m e « 0.4866 MeV and w 102.718 MeV at 



the electroweak scale [19], the upper bound 9 13 < 12° |T8] leads us to — 14.7m e < 
< — m„ at the same energy scale. In view of r l = 3m /q ~ 3m /m T together 



m 



vq - ""e 

with m T w 1746.24 MeV at the electroweak scale 

-4 



< r, < 



-8.4 x 10" 







13 



0° for 



we find -1.2 x 10" 2 
So the magnitude of r ; is strongly suppressed. Of course, we have 
and 6 13 ~ arcsin J2m e /(3m ) ~ 3.2° for m 0. Once 



/??, 



m 



the value of # 13 is experimentally fixed, one may then be able to determine the 
important So-symmetry parameter m 



ti- 



the m -induced 



Because of \m Q \/m < Ybmjm^ ~ 0.071 at the electroweak scale, 
correction to 9 23 in Eq. (16) is apparently negligible. Thus e l m 9m M /(2m r ) 0.26 
and 5 l ~ V%£i sin 9 13 < 7.6 x 10 -2 . The smallness of r u /e u also makes its contribution 
to # 23 negligible. Taking m^/m T ps 0.0588 [19], we obtain # 23 p^ 38°. This result, 
which certainly depends on the assumed perturbation forms of AM; and AM U , is 
a bit lower than the best-fit value of 9 23 (i.e., 9 23 = 42.8° [18J) but lies in the 3cr 



interval of 9 23 (i.e., # 



'23 



42.8; 



-10.7° 
-7.3° 



[18j 



Note that the magnitude of r u can be determined only after the absolute mass scale 
of three neutrinos (i.e., c u ) is known. Taking c u ~ 0.1 eV for example, we find e v ~ 
Am| 2 /(2c 2 ) ~ 0.12 and therefore r v p^ 6.8 x 10~ 4 . The smallness of both r x and r v is 
consistent with our original expectations. Although r L and r v are two free parameters, 
they are intrinsical in the S 3 flavor symmetry and hence should be taken into account. We 
have demonstrated that both of them are phenomenologically important in understanding 
the lepton mass hierarchy and the flavor mixing pattern. 



3 We proceed to look at the quark sector. Based on the S 3 flavor symmetry, the 



mass matrices of up- and down-type quarks are written as 
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where c x > 0, r x is real and \r. 



1 holds (for x = u and d). For the sake of simplicity, 
the textures of AM U and AM d are taken to be exactly parallel to those of AM U and AM ; 
given in Eq. (8). In other words, 
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with < 5 X < ^ C 1 (for x = u and d). The diagonalization of M u and M d is almost 
the same as that of M v As a result, 



! + 9 + 3 



c, 1 + 



+ 
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2fu , £u 

9 3 
2e, 



9 3 

Defining m' = c u r u /3 and tUq = c d r d /3, we have 
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(20) 
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v/3 



(21) 



m 



where the phenomenologically uninteresting case with < m' Q < m u has been discarded. 
Furthermore, Eq. (20) gives rise to the constraints \m' \ < m u for m' < and ttiq < m d 
for rriQ > 0. Given V^M U V* = Diag{m M , m c , m t } and V d M d V d * = Diag{m d , m s , m b }, a 
careful perturbation calculation yields 



V„ 



v d 




(22) 



where x q = -y/35 q /(2£ q ) and y q = 2e q /9 (for q = u or d) have been defined. The quark 
flavor mixing matrix V CKM = V^V d [21)] turns out to be 



V =a 

* CKM ~ 



A u i.h d 



y d (2ix d + x u ) - 3x u y u \ 
Vu-Vd 



s/2 



V2 



V2 
1 



(23) 



/ 



where the 0(x^), 0(x d ), 0(x u x d ) and 0(y u y d ) corrections to the diagonal elements of 
V CKM have been neglected. This result clearly shows that the dominant term of V CKM is 
the identity matrix /, and thus its three flavor mixing angles must be small and sensitive 
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to the values of m' and mj. The latter should not be ignored not only because they have 
an impact on V CKM but also because they come from an intrinsic S 3 symmetry term. 

To examine whether Eq. (23) is compatible with current experimental data or not, 
we make use of the following values of quark masses at the electroweak scale |19j : 



m. 



(0.85 ~ 1.77) MeV , m d 
(0.535 - 0.703) GeV, m s 
(168.7 ~ 174.7) GeV , m b 



(1.71 ~ 4.14) MeV , 
(40-71) MeV, 
(2.80 - 2.98) GeV. 



(24) 



One may roughly take the geometric relations m u /m c m m c /m t ~ 1/300 and m d /m s 
m s /m b ~ 1/40 to illustrate the strong quark mass hierarchies. In our discussions m' <C m c 
and ?71q <C m s are reasonably assumed to assure that the perturbation calculations are 
valid. So the magnitudes of 5 U and 5 d are sensitive to m' and m[,', whereas those of e u 
and e d are not. In other words, x u (or x d ) may significantly deviate from ^Jm u /m c (or 

^Jm d /m s ) while y u (or y d ) is essentially equal to mjm t (or m s /m h ). These observations 
are helpful when we confront Eq. (23) with the experimental constraints on V CKM [5], 



\V f 
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n 041 e;+0-OOio 
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(25) 



Some discussions are in order. 



We obtain |V^| w \y ts \ \y u — y d \/\/2 w (m s /m b — m c /m t ) /a/2 in the leading-order 
approximation, which is too low to fit the observed values of \V cb \ and \V ts \. The 
reason for this discrepancy is simple: the diagonal patterns of AM U and AM d taken 
in Eq. (19) fail in producing a sufficiently large mixing angle between the second 
and third families in the quark sector. In fact, a similar problem has appeared in 
the lepton sector: the diagonal perturbation matrices AM ( and AM U in Eq. (8) 
are unable to produce 8 23 w rr/4 for the atmospheric neutrino mixing angle. A 
straightforward way out should be to find out a class of different patterns of AM X 
(for x = l,u, u, d), which might be off-diagonal or partially off-diagonal but can 
simultaneously make the mixing angle 8 23 of V MNS and the matrix elements \V cb \ 



and \V ts \ of V CKM large enough 

Here we are concerned about whether it is possible to achieve the experimentally- 
favored values of |V^ b |/|V^, 6 | and |V^|/|V^| in the presence of non- vanishing m' Q and 



m. 



because many of the hitherto-proposed quark mass ansatze predict |V^ 6 |/|V^ 



\Jm u /m c [22] which is badly lower than the present experimental value of \V ub \ 
Eq. (23) leads us to 
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(26) 
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In the m'n 



m'r 



case, we simply obtain \ V 



ub\ 



2Jm d /m s and \V td \/\V t 



tsl 



3y m d/ m s fr° m Eq. (26). These two results are apparently in conflict with the 
experimental data given in Eq. (25). Hence one has to switch on the contributions 
from m' Q and mj. To see how large m' and mj should be, we rewrite Eq. (26) as 
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x d 
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\v ts \ 2 



\v f 
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W I 2 
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(27) 



where i? = y u /y d . Because y n and y d are almost insensitive to m' and mj, we 
approximately have R ~ (m c m b )/(m t m s ) G [0.12, 0.31] from Eq. (24). Typically 
taking i? w 0.3 and adopting the best-fit values of |V^ 6 |/|V^, 6 | and |V^ d |/|V^ s | given 
in Eq. (25), we find x 2 fa 4.6 x 10 -2 and x 2 fa 8.0 x 10~ 4 . Accordingly, we get 



14m„, and 



3.2 x 10" 



input m u /m c fa 1/300 and m d /m s fa 1/40. In view of r u = 3m' /c u 



3m' '/c d fa 3m'^/m b} we obtain r u ps Ahm u /m t 



m d if we simply 
3m' /m t and 
5 x 10~ 4 (for m' > m u ) as well 
m d ) . The smallness of both r u and r d 
is consistent with the strong mass hierarchies of up- and down-type quarks which 
have been described by the democratic D term in the S 3 flavor symmetry limit. 



as r d fa 



±3m d /m b fa ±1.9 x 10 3 (for |md| 



In this ansatz the Cabibbo angle 8 C (i.e., sin# c 



\ v us\ ~ \ v cd\) is g iven b y 



6 C = arcsin ( | V us | ) ~ arcsin (|V^|) fa arcsin ( v/x 2 + x 



(2? 



With the inputs x 2 ~ 4.6 x 10~ 2 and x d ~ 8.0 x 10~ 4 obtained above, we obtain 
6 C fa 12.5° or equivalently \V US \ ~ \V cd \ fa 0.22. Such a result is quantitatively 
compatible with current experimental data, but it is qualitatively different from the 
conventional prediction sin# c fa ^Jm d /m s or sin# c fa \Jm d /m s — e l ^Jm u /'m c \ with 
</> being a free phase parameter based on a class of quark mass ansatze [231 GIJ EH] . 



Since CP violation has been observed in the quark sector, let us take a look at the 
consequences of our ansatz on four well-known rephasing invariants of CP violation: 
the Jarlskog parameter J [26J and three inner angles of the CKM unitarity triangle 
VudVub + V c dV*b + VtdVtb = [5] • m the leading-order approximation, we obtain 



and 



J = im(v us v cb v: b v*: 



--x u x d (y u y d ) 



-3x n x d \V cb \ 



(29) 



a = arg 
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v td v t ; 
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3x u x d (y u - y d Y 



3x u x d (y u — y d ) 



2x u y u - x d (y u - 3y d ) 

3x u x d (y u - y d ) 
_x 2 u (y d - 3y u ) - 2x 2 d y d 



(30) 
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Current experimental data yield \V cb \ ~ 0.0415, and the numerical exercises done 
above allow R = y u /y d ~ 0.3, x 2 4.6 x 10~ 2 and x\ ph 8.0 x 10~ 4 . Assuming 
x u and x d to have the opposite sign, we immediately obtain J <m 3.1 x 10 -5 . This 
result is in good agreement with the value of J given in Ref. [5]. In addition, we 
estimate the values of a, (3 and 7 in Eq. (30) and arrive at a ~ 80°, /3 ~ 23° and 
7 w 77°, which are essentially compatible with current experimental data [5]. 

Of course, our results depend on the diagonal perturbation patterns of AM U and AM d 
taken in Eq. (19). We shall carry out a systematic analysis of different forms of AM X 
(for x = I, v, u, d) elsewhere [21], in order to find out simpler and more realistic textures 
of fermion mass matrices motivated by the S 3 flavor symmetry. 



We have extended the standard electroweak model by introducing one Higgs 
triplet and realizing the type-II seesaw mechanism to generate finite neutrino masses, and 
then applied the S 3 flavor symmetry to both lepton and quark sectors. The resulting 
mass matrices of charged leptons, neutrinos, up-type quarks and down-type quarks have 
a universal form M x = £ X I + ( X D with I being the identity matrix and D being the 
democracy matrix (for x = I, v, u, d). The observed mass hierarchies of charged fermions 
can therefore be understood in the S 3 symmetry limit with £ x <C ( x (for x = /,u, d). 
We have also argued that £ v ^> Q u is likely to hold, implying a nearly degenerate mass 
spectrum for three neutrinos. Such a picture generally allows us to interpret why the 
quark flavor mixing matrix is close to I and why the lepton flavor mixing matrix may 
contain two large mixing angles originating from the diagonalization of D, after proper 
perturbations to M t , M v , M u and M d are taken into account. However, the I terms 
of M u M u and M d used to be ignored or dictated to be zero by means of the S 3L x S 3R 
symmetry. We have stressed that this term is important for two reasons: on the one hand, 
it is intrinsical in the S 3 symmetry limit and should not be forgotten; on the other hand, 
it can significantly modify the smallest lepton flavor mixing angle 8 l3 or the off-diagonal 
elements of the quark flavor mixing matrix. To illustrate, we have discussed a diagonal 
perturbation ansatz of M x to explicitly break the S 3 symmetry and calculate the mass 
spectra and flavor mixing patterns of leptons and quarks. We find that this simple ansatz 
is phenomenologically acceptable in the lepton sector, but it is difficult to produce correct 
\V cb \ and \V ts \ in the quark sector. 

We have pointed out that a straightforward way to modify our ansatz is to consider 
different patterns of the perturbation matrices AM ; , AM U , AM U and AM d . This requires 
a systematic analysis of fermion mass matrices based on the S 3 flavor symmetry, because 
there are many possibilities and the main criterion to select the favorite one is to see that 
its phenomenological consequences can be consistent very well with current experimental 
data on lepton and quark masses and flavor mixing parameters. We are going to do such 
a comprehensive but tedious analysis elsewhere |21j . 

One may also consider to combine the S 3 flavor symmetry with the type-I seesaw 
mechanism, the type-(I+II) seesaw mechanism or other mechanisms of neutrino mass 
generation [T4T, [27] . Of course, it is more interesting to simultaneously understand the 
lepton and quark flavor structures by means of the S 3 symmetry and its proper breaking 
mechanism. Some enlightening ideas in this kind of exercises are expected to be very help- 
ful in the study of other discrete flavor symmetries and their consequences or implications 
on fermion mass generation, flavor mixing and CP violation. 
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